Retrospective revaluation in sequential decision making: a tale of two systems.

نویسندگان

  • Samuel J Gershman
  • Arthur B Markman
  • A Ross Otto
چکیده

Recent computational theories of decision making in humans and animals have portrayed 2 systems locked in a battle for control of behavior. One system--variously termed model-free or habitual--favors actions that have previously led to reward, whereas a second--called the model-based or goal-directed system--favors actions that causally lead to reward according to the agent's internal model of the environment. Some evidence suggests that control can be shifted between these systems using neural or behavioral manipulations, but other evidence suggests that the systems are more intertwined than a competitive account would imply. In 4 behavioral experiments, using a retrospective revaluation design and a cognitive load manipulation, we show that human decisions are more consistent with a cooperative architecture in which the model-free system controls behavior, whereas the model-based system trains the model-free system by replaying and simulating experience.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Convergence in a sequential two stages decision making process

We analyze a sequential decision making process, in which at each stepthe decision is made in two stages. In the rst stage a partially optimalaction is chosen, which allows the decision maker to learn how to improveit under the new environment. We show how inertia (cost of changing)may lead the process to converge to a routine where no further changesare made. We illustrate our scheme with some...

متن کامل

A fuzzy group decision making approach to construction project risk management

Implementation of the risk management concepts into construction practice may enhance the performance of project by taking appropriate response actions against identified risks. This research proposes a multi-criteria group decision making approach for the evaluation of different alternative response scenarios. To take into account the uncertainties inherent in evaluation process, fuzzy logic i...

متن کامل

Optimizing Red Blood Cells Consumption Using Markov Decision Process

In healthcare systems, one of the important actions is related to perishable products such as red blood cells (RBCs) units that its consumption management in different periods can contribute greatly to the optimality of the system. In this paper, main goal is to enhance the ability of medical community to organize the RBCs units’ consumption in way to deliver the unit order timely with a focus ...

متن کامل

Two Stage Multiple Attribute Decision Making Problem in Iranian Gas Distribution Systems

The purpose of this paper is to present the possibility of replacing physical unit cost in transportation or distribution problems by an aggregate coefficient, getting qualitative and subjective considerations involved. The model for constructing aggregate cost is a two stage multiple attribute decision-making problems. In the first stage supply points, demand points and routes of transportatio...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Journal of experimental psychology. General

دوره 143 1  شماره 

صفحات  -

تاریخ انتشار 2014